Last summer i played a gig (60 song per night) and every song has several sequences, so click was not even an issue. I have a great time, anyway.
The good thing is that there?s no argue about you dragging in some part (i get really boring discussing that with the band), and it?s great to improve your drumming... go ahead buddy, you have nothing to lose. If they see that you can keep the tempo in the without the click eventually they?ll trust in your tempo.
Keep us posted.